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WatGamflik detection 



FIELD OF THE INVENTION 

The Ittvejrfioa xelates to a method and ancangement for detectbg a wateraiaiac^ 

InattiediasignaL 

5 BACKCaiOUND OF THE INVENTION 

UntU voyreceaUylheDVD copy-pioteotionoonimunhy conridfljed 

watennaik-detecdon&rplaybadJ^cojitrolinaPeM^ 

ROM or DVD-rewriter drive. Theinotlvatioa&rliiiBporilioiiwasfliatwateimaik-dete^ 
» apamlssive technology (ie. the playback or recarding de^cewWka wilii or without 

10 watemiaikdeteotor)asopposedtoeucryptlon,wMchrequlre9ade^^ 
toctianpr(q.erly. The ftagaeconseiisusi«ed to be lhat DVD-ROM 
MPEG2H«mpres8eduaenotyptedDVD.videocoiit«=irtondidcs&r^^^ copy-never 
or cqpy-once watermatk. If such were Uie case, playb adc should be stopped (copy-onoe or 
cppynnovar content should be encrypted at aU times). Note that such a drive neede an 

15 MEEGJ^-parser to at teastpartially decompress content to e^^^ 
Fig. i^wWdhahowsschcmatioallyaPC system arijhi^^ 

playbads^oouteol in tiie DVD-drive. 

However, a system withplaybadc-oontcol using a watermaik detector in the 

driveleavesmidofsecurityholesinanopen-arcHtectuxePC, One such security hole Is Ihat 
20 cont0nl«iayberecoidedlnscianibledfotmbyflippingallbit8.Sim^ 

oompUantMPEG2 slieam, thepareer Inthe drive wiU fell and no watennark wfllbe seen. 

UwbilHflipoanbeundonejurtbeforeor inside thomedia^layer software. Another such 

HeourflyholeistfatfcontoutfflaybeciWJpieasednotusingMP^ 

uadertiienflmeDiyX), fiactatoompreBrionsdJetnes, Endows Media, Real. etc. Since it is 
25 imposaibJetetheDVD-drivetohavepawetsonboardto(pardaUy)decampr^^ 

(andhackeiBwmiiwent new codecstooirtinart the drive), the watermark w^ 

detected. Al&ou^ (illegal) copies compressed wilii a codec oflxer than MPEG2 will 
generaUynotplayonou«entDVD.videoplayer8lliereiaa 

si^port more andmoirB codecs, 
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TheuBfott it has atoady been proposed to placo the Difatennaik detector after 

grapMos catd. After deoomffreadroi fliete is no l<ttiaar conjugjoti beogiiflB all jsmrtwrn- r^tfnpfj 

to file vneqiiivooal basehaad-fonnat ready fiw consiunptioii by httman ^yes. Hg. 2 shows 
5 scihfiiaatioallysiMAaPCsyBtem-awhitectiTO 

the gr^es oaid. However, it was coiMidered difSoDtt to enfsioe MPBG-deooder coo^anies 
or gr^hlos-oQid maunSiotarers to install suoh watermaifc detectors. This pereeption has 
changed since. An aiChitectiire is now bamg envisaged in which DVD-drives check, on boot- 
up, whether there is a gr^os-oaid with watetmad: detector present hi the PC. If such a 
10 gr^l&ics-caidwilhwatennaifc.deteetarianotpitesentto 

such a (pedal gr^hics caxd is pxesent however, it will output data. When the watetmark 
detector hi fflie gr^ddos oazd detects a wataanaik it will try to autheutioate to a compliant 
^llcadoQ ^dh is responsible fhr rendering the watennflikai data. If such aulhentication Is 
successful, the graphics a»rd conthxues operation (e.g. a valid DVD-Video is being played 
15 bacik wdng an authorized application). If it cannot find such a CQO^liant plication, the 

content nmst have come flom some nou-authorfzied sooroe, e.g. an illegally copied disk in the 
drive is bdng rendered by some pirate or other non-compliant sofiwaie. The graphics card 
will then shut down such ou^t Hg. 3 schematioally shows a aketoh of protocols hi such a 
PC architecture to msikd sure that all oonqaonents are ilincttoning assure watecmaik detection. 
20 In this Figure, "Auth." denotes an authentication process or device. Note that the compliant 
appHcation is certahi about the origins of the data which it is rendering because it has also 
anthentioated with the drive. Note also that the aiehitecture is mote general. For example, die 
source may also be an analog c^ture card, an MPBO-enooder card, or an 1EEB-13S)4 board, 
xsther than a DVD-drive. 

2S It will ibrtber be assumed diat the watennark detector is located on the 

output(s) of the graphics card, just before video data is converted to the analog domam or 
modulated hi the digital domain for transmission to A DVI-mooitor (see Fig. 2). Althou^ it 

is aiehiteotnraUy very shi^k and clean to detect watermarics hi the gi»phic^^ . 

theze are a number of problems with this location conneoted to the eaoimous amounts of 

30 (graphics) data that flow through the gia,phios part at huge speed, and the &ct that multiple 
streams can be displayed at die same time. 

The video comhig out of the grsgshic&^aid caa be at at^ mmbesr of 
resoluticMra, see die Table below: 
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Resofaitioii 


pixdHCsEoi^ [MH^] 


VGA 


640 x 480 


27 


XQA 


1024 x768 


70 


SXOA 


1280x1024 


116 


UXOA 


1600 X 1200 


170 


Teible: Comparison of the resolatiom sad pixel-olook of some 
coumioiii arauhics standards 



There are otber also otlier standards supported by some sofMoa cards, 'with intospolatifl® 
resolutions. Note that -die p£sel-<o)oo3c ibr somial liaB^aiid watennatk deteotioa (in PAL or 
NTSC)isl3.5MHz. 

5 Spedfioally, some of tiie laoblans Sat watermaik detection in the gr^pbics 

card are: 

1. iiieott^tinter&oebasi:^tol3xbi^erdatarate(UXaA-mode)coni|>avedto 
PAL/NTSC baseband-detection. BasdKmd detection requires one addititm ibr eivery 
pixel, so the adder has to woik 13x fester. 

10 2. lbs data on the outputs is in RGB fbaanat whereas most watennark-acawmes work with 
the Imoinanoe dhannel. Conversion &om ROB to Y requires 2 additions and 2 
mnMpIioatlons ((y/0.587) e 0.509 R + O + 0.194 B, where 0& R,G.B < 1). This is very 
costly, e^eoially at hi^ data rates. 
3. The potential ran^ of scales that the detector needs to deal with is very large. One of 

15 the bi^iest scales stiU preserving visual quality is to dii^lay the movie jEUll'-soreen on 

Hbfl monitor (blow up to 16Q0x 1200 or even more). Rou^y Hie lowest scale is when 
the video is reduced to 352x200 (a popular fiitmat for downloading movies fiom the 
intfl0i0t). Hie soaI&«BQgB horjjsontBUy is fhus 0.5. . .2.2 and vertically 0.4. . .2.5, whereas 
cimreatly svailfiible watermadcdeteotoni are designed to deal wilii scales in the range 

20 0.5...!^. 

4. . . As diowninFig.-2, fiiere ace vsuaUy multiple outputs on the gcaphies card^ Gurrentibr - 
VQAj-ont and TV-ont (Ibr displaying a DYD-mo vie tendered on a PC on a Iiving-«ooin 
TV). Recently tte digital TyVUakxSaao has been added to this palette. Because all 
these ontputs can be GontroUed indepeodendy CUe. display difiEbvent data)^ naively the 
25 mmdaer of detectors sliould equal to the nmnber of outputs, which constitutias a 

significant cost-burden. 
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5. fil the aroUtectine of Figs. 2 and 3» a hacsloer may perfoxm the foUowing liack:: (s)iie 
copies illegal contmt iTfdiioli (s)he waxrts to watdh fiom a DVD+R to the HDD, without 

leering. Then fa)he plays any valid moteoted DVD *video fiom the DVD-driTO-Mfe_a_ 

caxxvliant £pplioatloxL in one wkidow, while the illegal matedal is rendexed by a non" 
5 compliarrf application in another window. The watexmatic detector will find a 

watemiark but that is (it tbinks) consistent with the oiighial movie in Hie drive. Thus 
the illegal material i? not cau^. It is even possible to abuse a compliant application: 
the illegal content from the HDD can re^encrypted with CSS (whidi has hem hacked), 
thus disgu:^g it as valid content This ReCSS-ed content is thus accepted by ibe 
10 compliant player, and affcer watermark detection in the giiaphics card^ this etpplicatioii 

will vouch £br it 

6. If a watermark is found by the compliant graphics card but no compliant application 
which produced the (watetmsrked) video can be found (or the drive cannot confirm that 
flie source is indeed a DVD-Video disk)^ what should tbe graphics caid do to stop fho 

15 display of the illegal movie? 

7. In the architectme of Fi^. 2 and 3, a hacker may perfiizm the fbllowlng hack: be 
inserte a second non«compliant graphics card into ibQ PC. He allows the drive to 
authenticate to the graphics card (using a hacked driver), while he uses the non- 
compliant card to playback illegal material ftom the drive, A second hack scenario is 

20 whenhe only inserte anon^conipliant graphics card into his PC but connects the PC via 

a network (home netwoik or internet) to another PC with a compliant graphics card. 
After authenticathig the drive witii the remote compliant gr^bics^-card^ illegal content 
is displayed on the on-boacd non-compliant gr^hics card. A thixd haok scenario is 
where there is a con^liant DVD-drive and a compliant grsphlcs card with wateimark 

25 detector in a sin^e PC: after authentication Oie hacker streams the data ftrom illegal 

disk in Ihie drive to a non*^ompliant application running on another PC witb anon-^ 
contpfiant gciqpblcs card somewbere in the network. 

8. . A badEermayc^en uptiiegrapMcs card and learn fh^ • 

(like what happened to DVD-Video), and pubUdx it on the net. From thm on, a 

30 compliant grapbics card can always bo hnpersonated by a non-concqpliant graphics card 

phis special softvrare tool using this secret. Of oouise tiie badk^ may also steal the 
watermark-secret, but removing a watcsmunk ftom a movie is computationdly mudi 
more work intensive flian ftWng an authentication. 
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OB JBCJT AND SUMMARY OF THE INVENTION 

In 003 section we provide a set of possible soMoiis to the piobl^ois 1 to 8 
5 mentioned above. The same numbering is adhered to. 

1, Trivially: tbe pixel-data is siib-sanvled in qaace end titne (by skipping): e^g. &e only 
infonnation used &rdeteefion is line Ifiomfrm I^lm0 2ftomflame2et€. 
Alternatively, only a part of the images is being watexmaxk detected: see also solution 3 
below. 

10 2. The multiplications to convert firom RGB to Y can be avoided by approximating Y,, 
e.g. Y « 0^ R + 0*5 G + 0.125 B =R/4 + G/2 + B/8 which can be implemented with 
only arithmetic shifts. Furthennore, to economise on additions^ we can approximate 
fixrfher Yp^q (because G is dominant). 

Alternatively, the 3 primary colors B,G»B can be acoiunnlated / folded / processed 
15 separately^ using 3 separate jbld-buffers. Then alter folding, RGB canbe converted to 

Y ofif-line^ instead of on-fbe-fly (this is muoih like the way in which known watermark 
detectors accumulate DCT-coefSdents on which finally an IDCT is performed rather 
tiuin perlbruing an IDCT on-th»-fly and then accumulate the resulting pixels). This 
procedure takes 3 times mote memory but it can usually still be neglected w.r.t. the 
20 flfwttnnfei of video-memcuy used for other purposes. Memory bandwidth can be a 

problem thoughy because 3 times as much data must be transported to memory* 
3. It is usually quite easy to distboguish video fiom aU tihe other hiformation on the 

desktop, because real-time video contains many more diauges. This could lead to the 
fbUowing solutions: 
25 a. the watemuirk defector aUnes the (tin:esho]ded)G^ 

previous firame. ft tries to fit a bounding box around (reclaw^^ 

includes) areas with significant change. That bounding box w^ be considered a 

window on wMoh normal watemiaric detection (scale detection followed by 

payload detection) is pevfonned. In other words^wl^erea^ before we 
30 scale detection and payload detection, we have now added ^'azea-^of^interest- 

deteotion". Fig, 4 shoes schematically the atrnoture of graphics-card watomark- 
detection accOTding to tids solution, 
b. same bb atj but the dhaui^etectlon is pexfomed on a suVsampled video-flrame 
to conserve storage spara. 
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c. pame as a, but tixe change-deteotion i$ perfonnad ^look-fbr-bloc]k^' (e.g. Sm tty 
to find the change-areas in the top-left corner, tbsn ia the ^•dg^t coiner etcO. 

It is well known from the Hter atute how, starting ftom an aafea of acdvitv one can 

detetmine the tij^at possible boiinding-bax (red rectan^e in figoio above) incbidisoig 
5 snoh a point. If the content in the afea^of-interest is now ypsampled or downsanopled to 

the normal 720x480 or 720x576 foraiatp and suppUed to a normal baseband watermark 
detector* it is very likely ibat the content is now processed at a scale snfiaoienfly close 
to 1.0. 

4. Tbne-mnltqplex the watermark detector onto the dlfferexit oii^ts: i.e. first detect for a 
10 fixed amount of time on output 1, then on output 2 eto.. It is also possible to check all 

ott^uts simultaneously. 

5. Wh^ the detector has found watermarked content^ which (through authentlGation) can 
bo traced back to a compliant application or drivOji the watermark detector should 
continue to search other areas of Ihe display, to sear^ illegal content with watennarlcs. 

15 Jn practice one could implement this by starting the bounding-box search of solution 3 

at a random point on the display, to avoid ending up with the same bounding-box all 
the tune. As an altemalive the graphics card may notify the drive of the watetmark- 
payload using the authenticated channel set up at boot-time. The drive can verify firom 
the disk Tvhefher this watexmazk-payload is commensurate with this diak. If not^ some 

20 other source of copied material must exist. Note ttiat far this method to work^ the 

watermatk^payload needs to be stored on the disk in a mam^ that it cannot be 
retrieved by a hacker, e.g. in some currently unused sector in the lead-in aiea. This does 
not add cost to the drive. 

6. Udng the information from change detection in solution 3, blank out, fog over, or 

25 otherwise destroy the viewing pleasure of the boxed area in which the watermaxk was 

detected, Altemativelyi scsroU a message across the whole image indicating the 
detection of a watermark in a noU'^authenticated stream. 

7. . . The operatingaystem and the BIOS areihe only entities in the PC which have reliable - - 

knowledge about the ptug^in caxd configuradon of the PC. A solution Sxc the first hado* 
3 0 scenario is fbr the BIOS or OS to prohibit conobinations of compliant and non- 

compliant gr^fldcs caxds in a PC (for security teasons). A solution fbr the second hack- 
scenario is fbr OS and BIOS to disallow authentioadon with gnphics cards across the 
netwoik. A way to implemeot this would be for the OS to query the drive which 
graces card it aitfhenticated with and to check that the device is indeed on board. This 
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obviously lequires a secnte OS. If it is a maiket requirement that pteybacfc fioan a 
lonoteDVD-driveinalwjmeiwtmsdcs^ the second fioenario bacifc of 

ptoblcm 7 osanot be prevented. Annflier sohitton ia ftir the OS to pmhibit oatnbinirtioaB 
of ooxr^Hant delve aiidnoiirConq?liaii4 gn^Di^s «sanl in ^ same box. 



g. The aBtheirtUJatlon-«ch«ii» fi» Qie watennaiK aeraoior biw««* »mmmv»*^ a 
tevooadon stihame as dian^iowsd by 
opens i^agr^jhioscatd, audi cajdcm bo rwok»dby(oBnno 

TviflO drives, OS-es, media eto. 

Notelliat, 88 mentioned befiae^ the DVD-drive couldbo replaced by aa^ 

10 cofflpliant source of data in Uiese solutions. 

The invention can be aimimaiiiaed as fellows. Watemaik-^^^ 

graphics caM for the pinpose of copy-proteotloninaPa has woertf^ 
attentionin standardization. Hi>virever, detection in a gn«>(hloB oaid has problems oampletaOy 
di^tftom the formerly considered detection intheDVD^ve, having toto 
data^rates, large scale-ranges and presence of mult^le video-streams in Ito displ^ area. 1Mb 
disolosiiie discusses a number of ^foaohss to oonftont these proWems. 
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1. Ams&iodmdmaasiBmBXASst^si^^ 
as descdbed lierelnbecfore. 
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Wat^mwJc-detecttoa in a gB«to oaid for flie pwpose of «»py-pioteoti<tti in a PC. has 
recently startedto dmw alot of att«nt«mlii rtandardi^ However, deteotlonin agi«phios 
caidhas piobleana con«.letdy diflfetent ftomihe fi^ 
drive, tovfagtodo wife WghdataptatM, large scale.^ 

streemB toUie display area. Tlds disdosuie disottflses anumberof ^mfliesto conftont 



feese problems. 
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